Preferential attachment alone is not sufficient to generate scale free random networks 
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Many networks exhibit scale free behaviour where their degree distribution obeys a power law 
for large vertex degrees. Models constructed to explain this phenomena have relied on preferential 
attachment where the networks grow by the addition of both vertices and edges, and the edges attach 
themselves to a vertex with a probability proportional to its degree. Simulations hint, though not 
conclusively, that both growth and preferential attachment are necessary for scale free behaviour. 
We derive analytic expressions for degree distributions for networks that grow by the addition of 
edges to a fixed number of vertices, based on both linear and non- linear preferential attachment, and 
show that they fall off exponentially as would be expected for purely random networks. From this 
we conclude that preferential attachment alone might be necessary but is certainly not a sufficient 
condition for generating scale free networks. 

PACS numbers: 89. 75. Da, 87.18.Sn, 02.10.Ox 



Many natural and man made networks possess a scale 
free degree distribution where the tail of the distribution 
follows a power law These networks are particularly 
interesting because they hint at complicated processes 
underlying their generation - processes sufficiently com- 
plex that the resulting networks cannot be described by a 
few simple parameters like the mean and standard devi- 
ation. Generative models that have been constructed to 
explain this behaviour assume networks grow by adding 
vertices one by one, with each vertex having a fixed num- 
ber of either directed or undirected edges that connect to 
other existingvertices with a probability proportional to 
their degree [2,[3|. For most models, in the limit of large 
network size, the distribution for large degrees falls off 
with an exponent that is between 2 and 3. The basic 
linear preferential model has been extended to include 
the addition and removal of edges after the vertices have 
been added and again the networks have been shown to 
be scale free 0-0] • Finally it has been shown that mod- 
els, where the probability of attachment to a vertex goes 
as a power of the degree of the vertex, generate stretched 
exponentials when that power is less than one [8]. For 
reviews of these and other results on random graphs in 
general see . For a particularly readable and pedagog- 
ical treatment of these results see [lol |. 

All these models are variants of the basic citation net- 
work, where the network grows both by the addition of 
vertices and of edges. One of the characteristics of these 
models is that older vertices in the network - those added 
earlier in the growth process - have more time to acquire 
edges than more recent vertices and, in fact, it has been 
shown that these vertices on the average have a higher de- 
gree [m . Simulations seem to indicate that both growth 
(of vertices) and preferential attachment are necessary for 
scale free behaviour although the result is not conclusive. 
Detecting power law behaviours in simulation data or real 
world data is difficult because of the large fluctuations 
that occur in the tail of the distribution jlj] . While sim- 



ulation of the growth of a citation network without pref- 
erential attachment clearly shows exponential behaviour, 
simulation results for edges attached to a fixed number 
of vertices through preferential attachment never seem 
to have attained a stationary state - initially the degree 
distribution seems to show scale free behaviour but then 
the network reaches saturation, where all the vertices are 
fully interconnected Q. In this paper we derive ana- 
lytic expressions for the degree distribution of networks 
where edges attach themselves to a fixed number of ver- 
tices through preferential attachment (both linear and 
non-linear) and show that the degree distributions fall 
off exponentially just as you would expect for purely ran- 
dom networks. Thus preferential attachment might be a 
necessary but is certainly not a sufficient condition for 
generating networks with scale free degree distributions. 

We construct our generative network model by consid- 
ering n vertices and then grow the network by attaching 
edges to vertices, or more accurately ends of edges (stubs) 
to vertices. At each time step we add the end of an undi- 
rected edge to one of the n vertices based on some prob- 
ability pk- The other end of the edge is then attached 
to any of the n vertices with a probability drawn from 
the same distribution pk. At time t, (t even), the stubs 
attached to the vertices can be connected randomly to 
produce one, among many equally likely, network config- 
urations all with the same degree sequence and distribu- 
tion. In the process of growing, at any given time t, the 
network will have t/2 edges. At any time in the growth 

n 

of the network, t — J2 where ki is the degree of the 

1=1 

ith vertex. In this model the other end of the edge can 
be attached to the same vertex producing self-edges or 
"tadpoles". We also do not rule out multi-edges, where 
two vertices can have more than one edge (" melons" ) . It 
has been shown that the number of either self-edges or 
multi-edges remains constant as the network grows if the 

second moment of the degree distribution, k-^ — J2 ^f/^^j 

i=l 
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is finite and independent of n. We will show that in our 
model the distribution falls off exponentially for large de- 
grees and therefore in the large n limit the presence of 
self-edges or multi-edges should not have any bearing on 
our fundamental result. 

We derive a master equation for the evolution of the 
degree distribution by considering an ensemble of net- 
works growing in the manner described above. M, t — 0, 
the network starts off with n vertices, and no edges. At 
every time step, we add a stub, or the end of an edge to 
a vertex with probability given by 



Pk (7) oc (a -I- k^) 



(1) 



where a is a positive constant (typically set to around 
1) which ensures that all vertices, including those with 
degree get a base chance at acquiring edges, and 7 is 
a positive constant between and 1. (It has been shown 
that for 7 > 1, a single vertex gains a non-zero fraction 
of all edges and we will not be considering it here 0].) 
The properly normalized probability for the attachment 
of a stub to a vertex is given by 



Vk (7) 



N{k,t) (a-l-fcT) 
n [a+ < fcT > (t)] ' 



fc > 1 and (2) 



n [a+ < > (t)\ 
where N {k,t) is the number of vertices of degree k at 

n 

time t. In the above equations < k'' > (t) — ^ k^' /n. In 

1=1 

the linear attachment model, 7=1, and 



Kk'' > {t)^ - = k, 
n 



(4) 



where k is the mean degree of a vertex at time t in the evo- 
lution of the network. Notice that when 7 = or when 
a — >■ cxD, Pk — N (fc, t) /n, where the stubs are attached 
to vertices perfectly randomly and the network generated 
will be a completely random graph. (The slightly differ- 
ent form for the probability for fc = ensures that it has 
the right limit when 7 = 

With the degree distribution given by P{k,t) = 
N (fc, t) /n, the master equation for the time evolution 
of P (fc, t) can be shown to be 



P(fc,t + l,7) = P(fc,i,7) 1- 



[a + fc"^] 
n \a+ < k'y >] 



+ P(fc-l,t,7) 



n [a+ < fc-T >] ' 



(5) 



with P {k,t) satisfying the initial condition, P(fc, 0) — 
Skfi- In the equation above, at time step t+1, the second 
term describes the average loss of the number of vertices 
of degree fc because of a stub attaching to a vertex of 
degree fc while the third term describes the gain in the 
number of vertices of degree fc because of the attachment 
of a stub to a vertex of degree fc — 1 . Since the maximum 
degree of any vertex at time t cannot exceed t, P (fc, t) = 
for k>t. 

It is difficult to solve the master equation exactly for 
all 7. However in the n — > 00 limit, the equation can be 
solved exactly for 7 = 1, the linear preferential attach- 
ment model, where it has been argued networks exhibit 
power law behaviour for large fc. For 7 < 1, even if we 
cannot derive the exact form of the distribution, we will 
deduce the leading large fc behaviour of the degree distri- 
bution in the n — > 00 limit. We first recast the master 
equation in a form that makes it easier to get the lead- 
ing terms in an 1 /n expansion of the degree distribution. 
To do that, notice that it is easy to get the form of the 
solution for fc = by induction. It is given by 

^^(0,^,7) - ff (l - , • (6) 

;il n[a+<fc7>(j)]/ 



The solution for the first few fc and t values suggest trying 
a general solution of the form 

p ^) - n + n { 1 - nia+<k-^lm } ^ ^) 

_ (7) 

where F{k,t,^) is to be determined. Substituting this 
form for the solution in the master equation then gives 

F (fc, t + 1, 7) = p (fc, t, 7)+ ri^'.^'U^ -^ ^) ^h^'^e 

n [a+ < k ' > {t)\ 

(8) 

*n /l - (a+(fc-l)^) 1 
111^ n[a+<k-<>(l)]] 

L{k,t,j)^^ -• (9) 

n li \ 

11 I n[a+<k-'>{m)] f 

In Eq.®, the second term explicitly is of 0{l/n), and 
so we can approximate and keep only the leading term 
in L (k,t^"f) in the limit n — > 00. In the large n limit, 
the products in the numerator and denominator can be 
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approximated by exponentials of sums giving Because the first exponential in L {k, t, 7) introduces 

higher order 1/n terms it can be set to 1. In the large n 
, [fcT-(fc-i)"'] 1 limit we then get for F (k, t, 7) 

L (fc,<,7) « e"[<'+<'=^>(*)i X e '=« 

(10) 



[fcT--(fc~l)7] 



(11) 



F(M + l,7)=F(M,7) + ;^||y^e 

I 

We next look at two special cases of 7 for solving the The degree distribution function in the n — > 00 limit 
equation for the distribution P (fc, t, 7). 



PREFERENTIAL LINEAR ATTACHMENT 



becomes 



P(fc,i,7 = l) 



T{a + k) 



r(a) (na)'fc! (t ~ k)l 



a-{-k 



(18) 

In the preferential linear attachment model, 7 = 1 in Since we are mainly interested in the t — S- 00 hmit, such 
the formulas for pk (7) in Eq. © and Eq. © . Setting that t/n = k is finite, we get 



7 = 1 in Eq. ((T]), and using the same approximation 
for large n we used in Eq. (|10p . and using the fact that 
< k >= t/n, the distribution function then becomes 



F(fc,t,7 = l) = 



r(a + fc) 



r(a)r(A; + l) [1 + k/a] 



k/c 



1 + k/a 



(19) 



^ ' ' ^ r(a)r(fc + i) 

and F is now given by 



xF{k,t,l), 
(12) 



(fc, t + 1, 1) = (fc, 1) + ^^.^"^'5^^ e'^" 



For large n, 



i=0 



na + i\ 



[na + 1] 



{na + t) --^1 (n)} « In 



Importantly, in the large k limit, as k — > 00, 

P(/C,t,7= 1) - k^-^g^klnil+a/k)^ (20) 

and the leading k dependence falls off exponentially 
rather than as a power law. 

NON-LINEAR ATTACHMENT 



(13) 



na + t 



is the Psi function [12| . The equation for F now takes 
the simple form 

F{k- l,t, 1) 



We will show that the leading large k dependence falls 
off exponentially for arbitrary < 7 < 1 even though 
where we have not been able to get an exact form for the de- 
gree distribution. We start with the basic equation for 
(14) F{k,t,'-f) given by Eq. (fTTj) . We already saw that for 
7 = 1, is given by Eq. (fT7| . In the opposite limit of 
7 = 0, < fc^ >= 1, and the equation for F takes the form 



F {k,t + 1,1) = F{k,t) + 



(15) 



F {k,t+ 1,0) ^F{k,t,0)+ ^^'; (21) 

n(a + 1) 



which can be solved using generating functions Il3|- , . , . , 1 i •, 1 1 ■ r 

n ■ ,1 r ,• f7^nj-i\--LU 1 which cau agam be solved easily by the generatmg tunc- 

Dcnnmg the generatmg function of (fc, i, 1) m the usual . u j • j j o a 



way as G{k,z,l) — '^F{k,t,l)z* with | 2; |< 1, and 

t=Q 

G{k, 0, 1) — 6k,o, it can be shown that G{k, z, 1) satisfies 
the equation 



tion method to give 
F{k,t,Q) 



,k (a + i)" k\{t-ky: 



(22) 



G 



The solution for the degree distribution for arbitrary 7, 
(16) and large t now takes the form 



The coefficient of 2* then gives us 



k-l 



F{k,t,l) 



1 



P{k,t,^) 



{na)''k\{t-k)V 



(17) 



k\f{k,i) 



1 'L-J: n ^ [a+<fcT>(j)] 

Jl (a + P) e 



1=0 



(23) 
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where f{k,^), though an unknown function, goes from 

/(A:, 7 = 0) = {a + lf to /(/s,7 = l) = a''. Since 
fe-i J. 

n (a + < — 1) ) for large k, the degree distri- 

1=0 

bution becomes 



her vertices acquire excess edges, we conclude that pref- 
erential attachment alone is not a sufficient condition for 
generating scale free networks. 



P{k,t,l)< 



"Yll \a.+ <k1>U)] 
3=0 



(24) 

We expect that / (fc, 7) is a smooth well-behaved func- 
tion of 7 between the two limits 7 = and 7 = 1 in 
which case / « a'^. Since the summation in the expo- 
nential is a function only of we can conclude that the 
leading behaviour of P {k, t, 7) for large k is still a simple 
exponential. 

In conclusion, wc have shown that in models of pref- 
erential attachment, the resulting degree distribution for 
large degrees falls off exponentially when the model starts 
with a fixed number of vertices and adds edges so that 
they attach themselves to the vertices with a probability 
proportional to a power of the degree of the vertex. This 
is in contrast to preferential attachment models that are 
based on citation networks, where the network is con- 
structed by growing both the vertices and the edges and 
where it has been shown that the resulting degree distri- 
bution for large degree is either scale free or a stretched 
exponential. Since it is known that in these models ear- 
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